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DESCRIPTION 

Mechanical Device, Driving Method Thereof, and Recording Medium 
Technical Field 

The present invention relates to a mechanical device, a method 
for driving the mechanical device, and a recording medium. Actually, 
it relates to a mechanical device capable of providing a robot, etc. 
for changing behaviors depending on, for example, the liking of each 
user, a method for driving the mechanical device, and a recording medium . 

Background Art 

Conventionally, a number of robots (including stuffed animals) 
have been developed such that they start acting when a touch switch 
is pressed or when they detect voice at a level equal to or higher than 
a predetermined level, and have been put on the market as toys, etc. 

However, with the conventional robots,, the relationship of the 
behaviors of the robots with a touch-switch pressing operation and a 
voice input is fixed, and the user cannot change the behaviors of the 
robots according to the liking of the user. Therefore, the robots only 
repeat several limited behaviors, thereby boring most of the users. 



Disclosure of the Invention 

The present invention has been developed based on the above 
described background, and aims at providing a robot, etc. capable of 
outstandingly improving amusing elements. 

To solve the above described problems with the conventional robots, 
the mechanical device according to the present invention includes 
stimulus detection means for detecting a stimulus, control means for 
controlling drive means for performing a behavior based on a behavioral 
model prescribing a behavior; and changing means for changing a 
behavioral model based on a predetermined stimulus detected by the 
stimulus detection means. 

A stimulus can be provided by a user. 

The stimulus detection means is provided with a pressure sensor 
for detecting the pressure provided by a user as a stimulus. The 
changing means can change a behavioral model based on the pressure 
detected by the pressure sensor. 

The stimulus detection means is provided with a a pressure sensor 
for detecting the pressure provided by a user as a stimulus. The 
changing means can change a behavioral model based on the level or the 
length of the pressure detected by the pressure sensor. 

The stimulus detection means is provided with a microphone for 
collecting voice from a user as a stimulus,, The changing means can 
change a behavioral model based on the voice collected by the microphone . 

The stimulus detection means can be further provided with a speech 
recognition means for recognizing speech. The changing means can 
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change a behavioral model based on a speech recognition result of the 
speech obtained by the speech recognition means. 

The speech recognition means can be provided with a dictionary 
storing a word to be processed in a speech recognizing process 
corresponding to a method for changing a behavioral model so that any 
of the words stored jn the dictionary can be output as a speech 
recognition result. In this case, the changing means can change a 
behavioral model in the changing method corresponding to the word output 
as the speech recognition result. 

The stimulus detection means further comprises a prosody 
information detection means for detecting prosody information about 
voice. The changing means can change a behavioral model according to 
the prosody information detected by the prosody information detection 
means . 

A behavioral model can be defined as an automaton prescribed by 
a node corresponding to a state and an arc corresponding to an action. 
An arc is assigned a weight coefficient. An arc corresponding to an 
action is selected by a weight coefficient, and an action, that is, 
a predetermined behavior, is performed. In addition, a weight 
coefficient can be probability (hereinafter referred to as transition 
probability) . In this case, it is referred to as a probability 
automaton according to which a behavior (action) is generated based 
on the probability. The changing means can change a weight coefficient 
(transition probability) based on a stimulus detected by the stimulus 
detection means. Furthermore, a behavioral model can be not only a 
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model configured by an automaton^, but also a model configured by an 
algorithm such as a neural network, the If-Then rule, etc. 

After changing a behavioral model, the changing means can also 
restore the behavioral model to its original state corresponding to 
the lapse of time. 

The method for driving the mechanical device according to the 
present invention includes a controlling step of controlling the drive 
means for allowing the mechanical device to perform a behavior based 
on a behavioral model prescribing a behavior, a stimulus detecting step 
of detecting a stimulus, and a changing step of changing a behavioral 
model in response to a predetermined stimulus detected in the stimulus 
detecting step. 

Furthermore, the recording medium according to the present 
invention stores a program including a controlling step of controlling 
the drive means for allowing the mechanical device to perform a behavior 
based on a behavioral model prescribing a behavior, a stimulus detecting 
step of detecting a stimulus, and a changing step of changing a 
behavioral model in response to a predetermined stimulus detected in 
the stimulus detecting step. 

As described above, according to the mechanical device, the method 
for driving the mechanical device, and the recording medium thereof 
of the present invention, the drive means for performing a behavior 
is controlled based on a behavioral model prescribing a behavior, a 
stimulus is detected, and a behavioral model is changed based on the 
stimulus. Therefore, a behavioral model can be freely changed by 
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providing a predetermined stimulus. As a result, a robot, etc. can 
be provided with its amusing element much more improved. 

Brief Description of Drawings 

Figure 1 is an oblique view of an example of an appearance of an 
embodiment of a robot 1 to which the present invention is applied. 

Figure 2 is a block diagram of an internal configuration of the 
robot 1 . 

Figure 3 is a block diagram of a configuration of a control unit 

11 . 

Figure 4 shows a control program executed by a CPU 20. 
Figure 5 shows a probability automaton as a behavioral model. 
Figure 6 is a flowchart of a transition probability changing 
process . 

Figure 7 is a flowchart of an example of a variation of the 
transition probability changing process. 

Figure 8 is a block diagram of an example of a configuration 
according to an embodiment of a speech recognition device realized in 
function by a sensor process module MO 3. 

Figure 9 is a flowchart of an operation of a voice detection unit 

33. 

Figure 10 is a flowchart of an operation of a feature parameter 
extraction unit 31. 

Figure 11 is a flowchart of an operation of a matching unit 32. 
Figure 12 shows a dictionary. 
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Best Mode for Carrying Out the Invention 

Figure 1 shows an example of an appearance of an embodiment of 
a robot 1 to which the present invention is applied, and Figure 2 shows 
an example of an electrical configuration. 

According to the present embodiment, the robot 1 takes the form 
of a dog. A head unit 3 is attached to the front end of a belly unit 
2, and leg units 6A to 6D that comprise upper leg units 4A to 4D and 
lower leg units 5A to 5D are respectively attached to the right front, 
left front, right rear, and left rear portions of the belly unit 2. 
Furthermore, a tail unit lA is attached to the rear end of the belly 
unit 2. 

Each of the joint mechanisms connecting the tail unit lA with the 
belly unit 2, the head unit 3 with the belly unit 2, each of the upper 
leg units 4A to 4D with the belly unit 2, and the upper leg units 4A 
to 4D respectively with the lower leg units 5A to 5D is provided with 
motors 7^, I2, .../ to 7,, as actuators for driving corresponding motors 
7i to 7n, thereby freely rotating the tail unit lA and the head unit 
3 on the three axes, that is, the x, y, and z axes, freely rotating 
the upper leg units 4A to 4D on the two axes, that is, the x and y axes, 
and rotating the lower leg units 5A to 5D only on the x axis. Thus, 
the robot 1 can perform various behaviors. 

The head unit 3 is provided with a camera 8, a microphone 9, a 
pressure sensor 10, a speaker 13, and LEDs (light emitting diodes) 14 
as eyes in respective positions. A control unit 11 is mounted in the 
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belly unit 2. The camera 8 captures images of the surrounding objects 
including the user, and the microphone 9 collects surrounding voice 
including the user ' s voice . The pressure sensor 10 detects the pressure 
from the user, etc. The images of the surrounding objects captured 
by the camera 8, the surrounding voice collected by the microphone 9, 
and the pressure supplied to the head by the user and detected by the 
pressure sensor 10 are provided for the control unit 11 as an image 
signal SGI, a voice signal SG2, and a pressure detection signal SG3, 
respectively. 

The motors 7^ to 7^^ corresponding to the respective joint mechanisms 
are provided with the respective rotary encoders 12^ to 12^. The rotary 
encoders 12^ to 12^ detect the roration angles of the rotating spindles 
of the corresponding motors 7j^ to 7^. 

The rotation angles detected by the rotary encoders 12^ to 12^ are 
supplied to the control unit 11 respectively as angle detection signals 
SG4i to SG4n. 

The control unit 11 determines the surrounding situation, its own 
posture, etc. according to an image signal SGI, a voice signal SG2, 
a pressure detection signal SG3, and the angle detection signals SG4i 
to SG4tj, determines the behavior to be performed according to a 
preliminarily input control program, and drives necessary motors 7^^ to 
7f, based on the determination results. 

Thus, the robot 1 moves the tail unit lA, the head unit 2, the 
leg units 6A to 6D to enter a desired state and autonomously performs 
behaviors . 
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Figure 3 shows an example of the configuration of the control unit 
11 shown in Figure 2. 

Figure 11 is configured by a CPU (central processing unit) 20, 
program memory 21 configured by EEPROM (electrically erasable 
programmable read-only memory) , etc., RAM (random access memory) 22, 
as the work memory of the CPU 20, nonvolatile memory 23 storing data 
of spectrum waveforms of various types of voice, etc., an interface 
circuit (I/F) 24 for receiving various signals, and a motor driver 25 
for drive-controlling each of the motors 1^ to 7^ connected through a 
bus 26. 

The program memory 21 stores as control programs a sensor process 
program PGl, a behavior command generation program PG2, an action 
command generation module PG3, and a control command program PG4 as 
shown in Figure 4. The sensor process program PGl is configured by 
an image signal process module MOi and a sensor process module MO3 . The 
behavior command generation program PG2 is configured by a behavioral 
command selection module MO2 and a behavioral command selection 
evaluation module MO4 . 

When the CPU 2 0 executes the control programs PGl to PG4 in a time 
division manner, the motors 7^ to 7^ are driven, and the robot 1 performs 
various behaviors. 

That is, the CPU 2 0 fetches the image signal SGI provided from 
the camera 8 to the RAM 22 according to the sensor process program PGl 
through the interface circuit 24 and the bus 26. 
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When, a predetermined object, for example, a red and sphere object 
(ball) , is detected according to the fetched image signal SGI and the 
image signal process program module MOi of the sensor process program 
PGl, the CPU 20 generates image process information about the detection. 

Then, the CPU 2 0 generates a command to perform a behavior such 
as "sleeping", "sitting down", "standing up", etc. based on the image 
process information and the behavioral command selection program module 
MO2 of the behavioral command generation program PG2 . 

The behavioral command selection program module MO2 can be 
represented as, for example, a probability automaton as a behavioral 
model prescribing a behavior of the robot 1 as shown in Figure 5. In 
a probability automaton, a state is represented by nodes NODEq to NODEm, 
and the transition of a behavior is represented by an arc ARC^i (mO, 
ml=0, 1, . . . , M) indicating the transition from the node NODE^o 
corresponding to a state to the node NODE^^ corresponding to another 
state (which can be the same behavior) . 

In the arc ARCj^^ indicating the transition from a node NODE^^o to 
another node NODE^i, the transition probability P„i generated by the 
transition is set, and the transition of a node, that is, a change in 
the state, is determined based on the transition probability. 

In Figure 5, to avoid a complicated drawing, only the arcs ARCq 
to ARCm from the node NODEq to other nodes (including itself) NODEo to 
NODE,^ are shown relating to the probability automaton comprising M+1 
nodes . 



The CPU 20 determines according to the above described behavioral 
command selection program module MO^ and the image process information 
based on the probability as to what behavior is to be performed 
afterwards, and generates a command to perform a behavior corresponding 
to the determined behavior. 

Furthermore, according to the thus generated behavior command and 
the action command generation module PG3, the CPU 20 generates a 
practical behavior plan to perform a behavior corresponding to the 
behavior command generated according to the behavioral command 
selection module MOj of the behavioral command generation program PG2 . 
The behavior plan is a plan to drive each of the motors 1 ^ to 1^ to perform 
the specified behavior. 

Then, the CPU 20 computes the rotation angle for each of the motors 
7^ to 7n to practically drive and rotate each of the motors 7^ to 7^^ based 
on an analysis result obtained by analyzing by the sensor process program 
PGl the angle detection signals SG4i to 564^ according to the behavior 
plan, the control command generation program PG4, and the rotary 
encoders 12^ to 12t^. 

Then, the CPU 20 rotates the motors 7^ to 7^ by a desired degrees 
by transmitting drive signals SGS^ to SGS^ based on the computation 
result respectively to corresponding motors 7-^ to 7^. Thus, the robot 
1 can perform a behavior generated by the behavioral command generation 
program PG2 . 

As described above, the CPU 20 instructs the robot 1 to perform 
various behaviors by controlling each of the motors 7^ to 7^ according 
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to the image signal SGI output from the camera 8 , and the control programs 
PGl to PG4 stored in the program memory 21. 

Furthermore, according to the present eiribodiment, the evaluation 
of a user for the behavior of the robot 1 is recognized according to 
the voice signal SG2 output from the microphone 9 and the pressure 
det.ection signal SG3 output from the pressure sensor 10. Based on the 
recognition result of the evaluation, a behavior selection pattern can 
be changed. 

That is, the CPU 20 of the control unit 11 fetches the voice signal 
SG2 from the microphone 9 and the pressure detection signal SG3 from 
the pressure sensor to the RAM 22 sequentially through the interface 
circuit 24 and the bus 26 according to the sensor process program module 
MO3 of the sensor process program PGl. 

Then, the CPU 20 converts the voice signal SG2 fetched according 
to the sensor process program module MO3 of the sensor process program 
PGl into a spectrum waveform of voice, and compares the spectrum waveform 
with each of the spectrum waveforms of various words used when people 
praise or scold their pets such as "Stop!", "Good!", "Hey!", 

Furthermore, when the spectrum waveform of the voice signal SG2 
substantially matches based on the comparison result the spectrum 
waveform of a word which is used when people praise their pets, and 
is registered in the nonvolatile memory 23, the CPU 20 determines that 
the user has praised the robot 1. When the spectrum waveform of the 
voice signal SG2 substantially matches based on the comparison result 
the spectrum waveform of a word which is used when people scold their 
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pets, and is registered in the nonvolatile memory 23, the CPU 20 
determines that the user has scolded the robot 1. 

When the evaluation is, for example, "praise" according to the 
evaluation of the user and the behavioral command selection evaluation 
program module MO4 of the behavioral command generation program PG2, 
the CPU 20 computes a new transition probability obtained by raising, 
by a predetermined rate (for example, 10%) , the transition probability 
Pj„ from the behavior (hereinafter referred to as a preceding behavior) 
preceding in the probability automaton (that is, the behavioral command 
selection program module MOj) shown in Figure 5 to the behavior 
(hereinafter referred to as a transition behavior) to be transferred 
to or to which transfer has already been performed, and a new transition 
probability to each behavior when the transition probability (the 
transition probability excluding P„ from the transition probability Pg 
to Pm) from the preceding behavior to another behavior is lowered by 
the same rate, and changes, based on the computation results, each of 
the transition probability Pq to P^ of the probability automaton in the 
behavioral command selection program module MO2 respectively into the 
newly computed values. 

When the evaluation is, for example, "scolding" according to the 
evaluation of the user and the behavioral command selection evaluation 
program module MO4 of the behavioral command generation program PG2, 
the CPU 20 computes a new transition probability obtained by lowering, 
by a predetermined rate (for example, 10%) , the transition probability 
from the preceding behavior to the transition behavior, and a new 
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transition probability to each behavior when the transition probability 
from the preceding behavior to another behavior is raised by the same 
rate, and changes, based on the compiatation results, each of the 
transition probability Pq to of the probability automaton in the 
behavioral command selection program module MO2 respectively into the 
newly computed values. 

Similarly, the CPU 20 determines that the robot has been stroked 
(praised) by the user when, for example, low pressure is detected for 
a predetermined time length according to the pressure detection signal 
SG3 from the pressure sensor 10 and the sensor process program module 
MO3 of the sensor process program PGl, and determines that the robot 
has been flapped (scolded) by the user when high pressure is detected 
for a short time. 

When the evaluation refers to "praise" according to the evaluation 
of the user who has made determination as described above, and the 
behavioral command selection evaluation program module MO4 of the 
behavioral command generation program PG2, the CPU 20 raises the 
transition probability P^, from a preceding behavior to a transition 
behavior in the behavioral command selection program module MO2 by a 
predetermined rate (for example, 10%) as in the above described case, 
and lowers the transition probability from the preceding behavior to 
another behavior by the same rate. 

When the evaluation refers to "scolding", the CPU 20 lowers the 
transition probability P„ from a preceding behavior to a transition 
behavior in the behavioral command selection program module MO2 by a 
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predetermined rate (for example, 10%) , and raises the transition 
probability from the preceding behavior to another behavior by the same 
rate . 

Thus, according to the present embodiment, the robot 1 learns the 
evaluation of the user for the behavior of the robot 1 according to 
the voice signal SG2 and the pressure detection signal SG3, and the 
learning result reflects on the behaviors to be performed hereafter. 

Described below by referring to the flowchart shown in Figure 6 
is the transition probability changing process for changing the 
transition probability Pq to prescribing the probability automaton 
as a behavioral model by the CPU 20 executing the behavioral command 
selection evaluation program module MO4 . 

When the robot 1 starts the transition from a preceding behavior 
to another behavior (transition behavior) , the CPU 20 starts the 
transition probability changing process, and determines in step SI 
whether or not the transition from the transition behavior to the next 
behavior has been performed. 

If it is determined in step Si that the transition from the 
transition behavior to the next behavior has been performed, the 
transition probability changing process terminates. If it is 
determined in step SI that the transition from the transition behavior 
to the next behavior has not been performed, then control is passed 
to step S2, and the CPU 20 determines whether or not the CPU 20 has 
changed the transition probability Pq to from the preceding behavior 
to each behavior. 
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If it is determined in step S2 that the CPU 20 has changed the 
transition probability to P^ from the preceding behavior to each 
behavior, then the transition probability changing process terminates. 
If it is determined in step S2 that the CPU 20 has not changed the 
transition probability Pq to P^ from the preceding behavior to each 
behavior, then control is passed to step S3, and the CPU 20 determines 
according to the voice signal SG2 and the pressure detection signal 
SG3 whether or not the user has represented the evaluation such as 
"praise", "scolding", etc., that is, whether or not the evaluation from 
the user has been detected in the sensor process program module MO3. 

If it is determined in step S3 that the evaluation has not been 
represented, then control is returned to step SI, and the similar 
processes are repeated. If it is determined in step S3 that the 
evaluation has been represented, then control is passed to step S4, 
and the CPU 20 determines whether or not the represented evaluation 
of the user is "praise". 

If it is determined in step S4 that the evaluation of the user 
is "praise", then control is passed to step S5, and the CPU 20 computes 
the new transition probability from a preceding behavior to another 
behavior by, for example, the following equation where Pq indicates the 
original transition probability, Pq' indicates the new transition 
probability, and L indicates the improvement ratio. 

Po' = Po X (1 + L) 

where 0 < L < 1 
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The CPU 20 also computes the new transition, probability from a 
preceding behavior to a transition behavior by, for example, the 
following equation where indicates the original transition 
probability, P^' indicates the new transition probability, and M+1 
indicates the total number of behaviors transferred from the preceding 
behavior . 

= Pm - (Po' - Po) / M 

where m = 1, 2, M 

The newly computed transition probability Po\ Pi ' ^ •••/ Pm' is 
provided for the behavior generation selection program module MOj, and 
the transition probability of the probability automaton as a behavioral 
model is updated, thereby terminating the transition probability 
changing process. 

If it is determined in step S4 that the evaluation of the user 
is not "praise", that is, the evaluation of the user is "scolding", 
then control is passed to step S6, and the CPU 20 computes the new 
transition probability from a preceding behavior to a transition 
behavior by, for example, the following equation where Pq indicates the 
original transition probability, Pq" indicates the new transition 
probability, and L indicates the lowering ratio. 

Po" = Po X L 

where 0 < L < 1 

The CPU 20 also computes the new transition probability from a 
preceding behavior to a transition behavior by, for example, the 
following equation where P„ indicates the original transition 
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probability, P„" indicates the new transition probability, and M+1 
indicates the total number of behaviors transferred from the preceding 
behavior . 

P„" = + (Po - Po") / M 

where ra = 1, 2, . . . , M 

The newly computed transition probability Pq", Pj", Pm" is 

provided for the behavior generation selection program module MOj, and 
the transition probability of the probability automaton as a behavioral 
model is updated, thereby terminating the transition probability 
changing process. 

In the above described transition probability changing process, 
if the user strokes the head of the robot 1 or says "Good! " to the robot 
1 when or after the robot 1 transfers from the first behavior to the 
second behavior, then the evaluation of "praise" is obtained, thereby 
easily transferring from the first behavior to the second behavior. 
In addition, if the user pats the head of the robot 1 or says "Hey!" 
to the robot 1, the evaluation of "anger" is obtained, thereby not easily 
transferring from the first behavior to the second behavior. 

As a result, the user uses the robot 1 for a long period while 
giving the robot 1 a stimulus to urge or suppress a behavior, thereby 
amending the transition probability of behaviors to the user desired 
pattern. That is, the user can experience the amusement of gradually 
training a pet such as a dog, a cat, etc., thereby largely improving 
the amusing element as a toy robot. 
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As shown in Figure 7 in which each unit is assigned the same unit 
number as the corresponding unit shown in Figure 6, voice or music 
representing a joy is output from the speaker 13 (step S5-2) after 
changing the transition probability corresponding to the probability 
automaton as a behavioral model in step S5, or voice or music 
representing sorrow is output from the speaker 13 (step S6-2) after 
changing the transition probability corresponding to the probability 
automaton in step S6. 

In addition to or instead of the output of the voice and music 
representing such a joy or sorrow, the LED 14 can be turned on in a 
predetermined lighting pattern indicating that the probability 
automaton has been changed, or it can be indicated that the probability 
automaton has been changed by such behaviors as wagging the tail unit 
lA, depressing the tail unit lA, etc. 

In addition, in the above described case, the nonvolatile memory 
23 can store the data of the spectrum waveforms of the words used for 
"praise" and "scolding", the sensor process module MO3 determines which 
the spectrum waveform of the voice signal SG2 from the microphone 9 
matches, the spectrum waveform of the word of "praise" or the spectrum 
waveform of the word of "scolding", and the evaluation of the user can 
be obtained based on the determination result. However, the sensor 
process module MO3 can also recognize speech according to the voice 
signal SG2 from the microphone 9 in other methods to obtain the 
evaluation of the user based on the speech recognition result. 
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Figure 8 shows an example of the configuration according to an 
embodiment of the speech recognition device for recognizing speech in, 
for example, the continuous distribution HMM (Hidden Markov Model) 
method. The speech recognition device can be functionally realized 
by the CPU 20 executing the sensor process module MO3 . 

The feature parameter extraction unit 31 can be provided with 
digital voice data obtained by A/D converting the voice signal SG2 from 
the microphone 9. 

The feature parameter extraction unit 31 performs, for example, 
the MFCC (Mel frequency cepstrum coefficient) analysis on the voice 
data input to the feature parameter extraction unit 31 for each 
appropriate frame, and outputs the analysis result as a feature 
parameter (feature vector) to the matching unit 32. The feature 
parameter extraction unit 31 can also extract, for example, a linear 
prediction coefficient, a cepstrum coefficient, a linear spectrum 
paring, the power for a predetermined frequency band (output of a filter 
bank), etc. as a feature parameter. 

The matching unit 32 recognizes the speech of the user input to 
the microphone 9 in the continuous distribution HMM method by referring 
to a sound model storage unit 34^ a dictionary storage unit 35, and 
a grammar storage unit 36 as necessary using a feature parameter from 
the feature parameter extraction unit 31. 

That is, the sound model storage unit 34 stores a sound model 
representing a feature in sound of voice to be recognized such as each 
phoneme, syllable, etc. in a language. Since speech is recognized in 
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the continuous distribution HMM method in this example, for example, 
an HMM (hidden Markov model) is used as a sound model. The dictionary 
storage unit 35 stores a dictionary describing the information (prosody 
information) about the pronunciation of each word to be recognized. 
The grammar storage unit 36 stores the grammar rules describing how 
each word entered in the dictionary in the dictionary storage unit 35 
is chained (connected) . As grammar rules, for example, rules based 
on a context free grammar (CFG) , a statistic word chain probability 
(N-gram) , etc. can be used. 

The matching unit 32 configures the sound model (word model) of 
a word by connecting a sound model stored in the sound model storage 
unit 34 by referring to the dictionary in the dictionary storage unit 
35. Furthermore, the matching unit 32 connects some word models by 
referring to the grammar rules stored in the grammar storage unit 36, 
and recognizes the voice input to the microphone 9 in the continuous 
distribution HMM method based on a feature parameter using a word model 
connected as described above. 

A word (string) as a speech recognition result obtained by the 
matching unit 32 is provided for the behavioral command selection 
evaluation module MO4 . In the behavioral command selection evaluation 
module MO4, the evaluation of the user is determined, and the transition 
probability is changed based on the speech recognition result from a 
part functioning as a speech recognition device shown in Figure 8 in 
the sensor process module MO3. 
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The voice detection unit 33 is provided with voice data provided 
for the feature parameter extraction unit 31 . The voice detection unit 
33 obtains, for example, the short-time power for the provided voice 
data, performs a self-correlation analysis, and determines based on 
the short-time power and the self-correlation analysis result whether 
or not the voice data as the voice of a user has been input . Furthermore, 
the voice detection unit 33 outputs a message announcing the existence 
of the input of voice data as the voice of a user to the feature parameter 
extraction unit 31 and the matching unit 32. The feature parameter 
extraction unit 31 and the matching unit 32 performs a process based 
on the message from the voice detection unit 33 only in the period in 
which voice data is input as the voice of a user. 

According to the embodiment shown in Figure 8, the voice detection 
unit 33 is mounted to detect the existence of the input of voice data 
as the voice of a user. However, it is also possible to detect the 
input of voice data as the voice of a user in equivalence by the matching 
unit 32 performing a word spotting process. The word spotting process 
can be performed using, for example, continuous speech recognition and 
a garbage model. In this case, the voice detection unit 33 can be 
omitted. 

Next, the operation of the speech recognition device shown in 
Figure 8 is described by referring to the flowchart shown in Figures 
9 to 11. 

First, the operation of the voice detection unit 33 is described 
below by referring to the flowchart shown in Figure 9. 
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In the voice detection unit 33, it is determined in step Sll whether 
or not voice data has been input as the voice of a user. That is, as 
described above, the voice detection unit 33 obtains, for example, the 
short-time power for the input to the voice detection unit 33, performs 
a self-correlation analysis, and determines based on the short-time 
power and the self-correlation analysis result whether or not the vo.ice 
data as the voice of a user has been input. 

If it is determined in step Sll that no voice data has been input 
as the voice of a user, control is returned to step Sll. If it is 
determined in step Sll that voice data has been input as the voice of 
the user, control is passed to step S12, and the input message informing 
that the data has been input is output to the feature parameter 
extraction unit 31 and the matching unit 32, thereby passing control 
to step S13. 

In step S13, it is determined whether or not voice data as the 
voice of a user has completely been input. The determination is made 
as in step Sll. 

If it is determined in step S13 that voice data as the voice of 
a user has not completely been input, that is, if voice data as the 
voice of a user is being input, control is returned to step 513. If 
it is determined in step S13 that voice data as the voice of a user 
has completely been input, then control is passed to step S14, and the 
termination message informing that the data has completely been input 
is output to the feature parameter extraction unit 31 and the matching 
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unit 32. Then, control is returned to step Sll, and the similar 
processes are repeated. 

The operation of the feature parameter extraction unit 31 is 
described below by referring to the flowchart shown in Figure 10, 

In the feature parameter extraction unit 31, it is determined in 
step S21 whether or not an input message has been received from the 
voice detection unit 33. If it is determined that the message has not 
been received, control is returned to step S21. 

If it is determined in step S21 that the message has been received, 
control is passed to step S22, and the feature parameter extraction 
unit 31 receives the voice data in 1 frame, thereby passing control 
to step S23. In step S23, the feature parameter extraction unit 21 
performs the MFCC analysis on the voice data for 1 frame received in 
step S22, and the feature parameter obtained as an analysis result is 
output to the matching unit 32 . 

Then, control is passed to step S24, and it is determined whether 
or not a termination message has been received from the voice detection 
unit 33. If it is determined in step S24 that the termination message 
has not been received, control is returned to step S22, and the similar 
processes are repeated. If it is determined in step S24 that the 
termination message has been received, then control is returned to step 
S21, and the similar processes are repeated. 

Then, the operation of the matching unit 32 is described below 
by referring to the flowchart shown in Figure 11. 
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In the matching unit 32, it is determined in step S31 whether or 
not an input message has been received from the voice detection unit 
33. If it is determined that the message has not been received, control 
is returned to step S31. 

If it is determined in step S31 that the message has been received, 
control is passed to step S32, and the matching unit 32 initializes 
a variable (for example, a variable for storage of an accumulation value 
of score of the HMM described later) for use in various operations, 
and control is passed to step S33. In step S33, it is determined whether 
or not a feature parameter in 1 frame has been received from the feature 
parameter extraction unit 31. If it is determined that the parameter 
has not been received, then control is returned to step S33. 

If it is determined in step S33 that a feature parameter in 1 frame 
has been received, then control is passed to step S34, and the matching 
unit 32 defines the frame of the feature parameter as a target frame, 
and performs an operation on the score of the HMM about the target frame 
using the received feature parameter, adds the result to the 
accumulation value of the score of the HMM obtained after receiving 
the input image, and obtains a new accumulation value. Furthermore, 
the matching unit 32 computes a confidence measure using the feature 
parameter of the target frame, and control is passed to step S35. In 
the voice detection unit 33, a range from the output of an input message 
to the output of a termination message is referred to as a voice range. 
However, in the voice detection unit 33, not a voice range, but a 
noise-only range in which a user does not enter a communications mode 
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can be mistakenly detected. Therefore, in this example, the confidence 
measure is computed, and the noise-only range mistakenly detected as 
a voice range can be deleted based on the confidence measure. 

A confidence measure can be computed based on the probability of 
a continuation time length by obtaining the probability of the 
continuation time length based on the distribution of the continuation 
time length of speech. The confidence measure can be a measure with 
the feature amount of voice other than the continuation time length 
taken into account. 

In step S35, a list of words which can be candidates for a speech 
recognition result is generated based on the accumulation value of the 
score of the HMM up to the target frame, and control is passed to step 
S36. In step S36, it is determined whether or not a termination message 
has been received from the voice detection unit 33. If it is determined 
in step S36 that a termination message has not been received, then 
control is returned to step S33, and the similar processes are repeated. 

If it is determined in step S36 that a termination message has 
been received, control is passed to step S37, and the word having the 
highest score is extracted as the final speech recognition result from 
the list, generated in step S35, of words which can be candidates for 
a speech recognition result, thereby passing control to step S38. 

In step S38, the speech recognition result is provided for the 
behavioral command selection evaluation module MO^, and control is 
returned to step S31, thereby repeating the similar processes. 
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As described above, the behavioral command selection evaluation 
module MO4 receives the speech recognition result output by the matching 
unit 32, determines the evaluation of the user based on the speech 
recognition result, and, based on the evaluation, changes the 
transition probability of the probability automaton (Figure 5) as a 
behavioral model as described by referring to steps S5 and S6 shown 
in Figure 6. 

In the dictionary stored in the dictionary storage unit 35 of the 
speech recognition device shown in Figure 8, the evaluation of a speaker 
when a word is given, and the rate of changing the transition probability 
when the word is given can be registered as corresponding to each word 
in addition to the prosody information about each word to be recognized 
as shown in Figure 12. In this case, the rate of changing the transition 
probability can be different for each word as a speech recognition result. 
Even if the speech of a user is evaluated as, for example, "anger" (or 
"praise"), the change rate of the transition probability can be 
different for each of the given words. 

That is, both "Better stop." and "Stop!" belong to the evaluation 
of "anger". However, when "Stop!" is given, as compared with "Better 
stop.", the change rate of the transition probability can be higher. 

In the dictionary shown in Figure 12, it is possible to associate 
each word with the change rate of the transition probability, an equation 
for changing the transition probability, and other methods of changing 
the transition probability. 
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In the case above, the transition probability is changed based 
on each word (string) as a speech recognition result. Furthermore, 
for example, as indicated by the dotted line shown in Figure 8, the 
feature parameter extraction unit 31 can obtain and output the prosody 
information such as the intonation, pitch, voice range of each phoneme, 
etc. of the speech of a user. Based on the prosody information, the 
change rate of the transition probability can be amended. 

As described above, the evaluation of a user can be recognized 
according to the voice signal SG2 output from the microphone 9 and the 
pressure detection signal SG3 output from the pressure sensor 10, and 
the transition probability of a behavior is changed based on the 
recognition result. Therefore, the transition probability of a 
behavior prescribing a behavioral model (probability automaton in the 
present embodiment) can be changed according to the liking of a user, 
thereby realizing a robot having an improved amusing element. In 
addition, depending on the physical stimulus detected by the pressure 
sensor 10, the evaluation of either "praise" or "scolding" represented 
respectively by "stroke" or "slap" can be obtained. Based on the 
evaluation, the transition probability can be changed at a 
predetermined rate. When a stimulus is given by the speech of a user, 
the robot can obtain from the speech recognition result, etc. the level 
of the user's "praise" or "anger" in addition to the evaluation of 
"praise" or "anger". Therefore, the transition probability can be 
changed stepwise at a rate based on the level of the user's "praise" 
or "anger" . 
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According to the above described embodiment, the present invention 
is applied to the robot 1 for entertainment. However, the present 
invention is not limited to this application, but can be widely applied 
to various mechanical devices 

In addition, according to the above described embodiment, the 
motors 1 1 to 7^^ are used as drive means for allowing the robot 1 to perform 
behaviors. However, the present invention is not limited to this, but 
other mechanical devices such as an actuator, a speaker, a buzzer, a 
lighting device, etc . can be used as drive means as long as the mechanical 
devices can represent a behavior (action) represented to other obj ects . 

Furthermore, according to the above described embodiment, the 
present invention is applied to change the transition pattern of the 
behaviors of the robot 1. However, the present invention is not limited 
to this application, but can change the transition pattern of the 
operations for a higher concept. 

Furthermore, according to the above described embodiment, voice 
and pressure is used as a stimulus for changing the transition 
probability Pq to of the behavior of the robot 1 in the probability 
automaton. However, the present invention is not limited to this 
application, but the robot 1 can be designed to recognize the expressions 
and behaviors of a user by processing an image, and change the transition 
probability Pq to of a behavior based on the recognition result. That 
is, various other stimuli can be used as long as the behavioral model 
(the probability automaton according to an embodiment of the present 



- 28 - 



invention) prescribing a behavior can be changed based on a 
predetermined stimulus from outside. 

In addition, according to the above described embodiment, the 
microphone 9 and the pressure sensor 10 are used as stimulus detection 
means for detecting a stimulus. However, the present invention is not 
limited to these means, but various other types of stimulus detection 
means can be used as long as the means can detect a predetermined 
stimulus . 

Furthermore, according to the above described embodiment, 
semiconductor memory (program memory 21) is applied as storage means 
for storing a behavioral model prescribing a behavior. However, the 
present invention is not limited to this memory, but other storage means 
such as disk or tape storage media, etc. can be used. 

Additionally, according to the above described embodiment, the 
CPU 20 for controlling the behavior of the entire robot 1 is used as 
control means for controlling the motors 7^ to 7^ based on the behavioral 
command selection module MO2 (probability automaton) stored in the 
program memory 21. However, the present invention is not limited to 
this means, but a CPU as control means can be mounted separately. 

Furthermore, according to the above described embodiment, a 
probability automaton is used as a behavioral model. However, the 
present invention is not limited to this application, but various other 
automatons such as an automaton in which a weight coefficient assigned 
to an arc is other than the transition probability can be used. In 
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addition to the automaton, algorithms such as a neural network, the 
IF-Then rule, etc. can be applied. 

According to the above described embodiment, corresponding 
transition probability in the probability automaton as a behavioral 
model can be changed only when voice of a predetermined pattern is 
detected or when pressure of a predetermined size and length is detected. 
However, the present invention is not limited to this application, but 
a changed transition probability in the probability automaton can be 
gradually or immediately restored to the original value when a 
predetermined time passes depending on the time lapse after the CPU 
20 changes corresponding transition probability in the probability 
automaton. Thus, the robot can be furthermore improved in an amusement 
element of an entertainment robot. 

Furthermore, in the initial state of the behavioral model 
(probability automaton) of the robot 1, the transition probability to 
a node corresponding to a behavior can be set to, for example, 0. In 
this case, the transition probability of 0 can be increased by receiving 
a stimulus. As a result, by receiving stimuli, the robot 1 can perform 
a behavior which cannot be performed in the initial state, thereby 
improving the amusing element as an entertainment robot. 

Additionally, according to the embodiment, a series of processes 
described above can be performed by the CPU 20 executing the program. 
The series of processes can also be performed by the exclusive hardware. 

A program can be stored in the program memory 21, and can also 
be stored (recorded) temporarily or permanently in a removable 
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recording medium such as a floppy disk, CD-ROM (compact disk read only 
memory), an MO (magneto-optical) disk, a DVD (digital versatile disk) , 
a magnetic disk, a semiconductor memory, etc. The above described 
removable recording medium can be provided as package software, and 
installed on the robot 1 (program memory 21) . 

In addition, a program can be installed to the program memory 21 
not only through a removable recording medium, but also by radio through 
a satellite for digital satellite broadcast from the download side, 
andby wire through a network such as a LAN ( local area network) , Internet, 
etc . 

In this case, when a program is updated, the updated program can 
be easily installed on the program memory 21. 

In the specification of the present invention, the process step 
describing the program for directing the CPU 20 to perform various 
processes is not always performed in a time series in the order of 
description, but contains a process (for example, a process in a parallel 
process or an object process) to be performed individually or in 
parallel . 

Furthermore, a program can be performed by a CPU or can be performed 
in a distributing process by a plurality of CPUs. 

Additionally, the transition probability can be changed by an 
algorithm other than the algorithm corresponding to the above described 
equations . 

Industrial Applicability 
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The present invention can be applied to an entertainment robot. 
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CLAIMS 



1. A mechanical device, characterized by comprising: 
drive means for performing a behavior; 

stimulus detection means for detecting a stimulus; 
storage means for storing a behavioral model prescribing a 
behavior; 

control means for controlling said drive means based on the 
behavioral model stored in said storage means; 

changing means for changing the behavioral model based on a 
predetermined stimulus detected by said stimulus detection means. 

2. The mechanical device according to claim 1, characterized in that 
said stimulus is provided by a user. 

3. The mechanical device according to claim 2, characteri zed in that : 
said stimulus detection means comprises a pressure sensor 

detecting pressure provided by the user as the stimulus; and 

said changing means changes the behavioral model based on the 
pressure detected by said pressure sensor. 

4. The mechanical device according to claim 2, characterized in that: 
said stimulus detection means comprises a pressure sensor 

detecting pressure provided by the user as the stimulus; and 
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said changing means changes the behavioral model based on a size 
and a length of the pressure detected by said pressure sensor. 

5. The mechanical device according to claim 2, characterized in that: 
said stimulus detection means comprises a microphone collecting 

voice provided by the user as the stimulus; and 

said changing means changes the behavioral model based on the voice 
collected by said microphone. 

6. The mechanical device according to claim 5, characteri zed in that : 
said stimulus detection means further comprises a speech 

recognition means recognizing the voice; and 

said changing means changes the behavioral model based on speech 
recognition result of the voice by said speech recognition means. 

7. The mechanical device according to claim 6, characterized in that: 
said speech recognition means comprises a dictionary storing a 

word to be voice-recognized corresponding to a method for changing the 
behavioral model, and outputting any of words stored in said dictionary 
as the speech recognition result; and 

said changing means changes the behavioral model according to the 
method for changing the behavioral model corresponding to the word as 
the speech recognition result. 

8. The mechanical device according to claim 5, characterized in that: 
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said stimulus detection means further comprises a prosody 
information detection means detecting prosody information about the 
voice; and 

said changing means changes the behavioral model according to the 
prosody information detected by said prosody information detection 
means . 

9. The mechanical device according to claim 1, characterized in that: 
said behavioral model is a probability automaton prescribed by 

a state corresponding to a behavior and transition probability of the 
state; and 

said changing means changes transition probability in the 
probability automaton based on the stimulus detected by said stimulus 
detection means. 

10. The mechanical device according to claim 1, characterized in that 
said changing means restores the behavioral model to an original state 
depending on a time lapse after changing the behavioral model. 

11. A method for driving a mechanical device, comprising: 

a controlling step of controlling drive means for allowing said 
mechanical device to perform a behavior based on a behavioral model 
prescribing a behavior; 

a stimulus detecting step of detecting a stimulus; and 
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a changing step of changing the behavioral model based on a 
predetermined stimulus detected in said stimulus detecting step. 

12. A recording medium, where a program by which a computer drives 
a mechanical device is recorded, characterized in that the program 
comprises : 

a controlling step of controlling drive means for allowing said 
mechanical device to perform a behavior based on a behavioral model 
prescribing a behavior; 

a stimulus detecting step of detecting a stimulus; and 
a changing step of changing the behavioral model based on a 
predetermined stimulus detected in said stimulus detecting step. 
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ABSTRACT 



Drive means for performing a behavior based on a behavioral model 
prescribing a behavior is controlled, and the behavioral model is 
changed depending on a predetermined stimulus. Therefore, by giving 
the stimulus, the behavioral model can be freely changed, and a 
mechanical device, etc. having an improved amusing element can be 
realized . 
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Explanation of Reference Numerals 

1 ... Robot, lA . . . Tail unit, 2 ... Belly unit, 3 ... Head unit, 4A 
to 4D ... Upper leg units, 5A to 5D ... Lower leg units, 6A to 6D ... 
Leg units, 7^ to 7„ ... Motors, 8 . . . Camera, 9 . . . Microphone, 10 . . . 
Pressure sensor, 11 . . , Control unit, 12, to 12„ ... Rotary encoders, 
13 . . . Speaker, 14 . . . LED, 20 . . . CPU, 21 . . . Program memory, 22 . . . 
RAM, 23 . . . Nonvolatile memory, 24 . . . I/F, 25 . . . Motor driver, 31 . . . 
Feature parameter extraction unit, 32 . . . Matching unit, 33 . . . Voice 
detection unit, 34 ... Sound model storage unit, 35 ... Dictionary 
storage unit, 36 . . . Grammar storage unit 
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I hereby state that I have reviewed and understand the contents 
of the above identified specification, including the claims, as 
amended by any amendment referred to above. 






I acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of Federal 
Regulations, Section 1.56. 


Burden Hour statement; 1 his lorm is estimated to take U.4 tiours to complete. Time will vary depending upon the need of the individual case. Any comments on the 
amount of time you are required to complete this form should be sent to Chief Information Officer, U.S. Patent and Trademark Office, Washington, DC 20231 DO 
NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner of Patents and Trademarks, Washington, DC 20231 
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5 Sms 8 (a)«: J: p C THBStliHK T, HSl 1 9 Si (ai 
•(d)«Xtil1 3 6 5«(b)at2£^v^TaStS$43fit« fc fc tic. 
«f5tfiS±«ti*fflH«ffiHHJ: 0 it|?offiBsH$^t4#HaT® 

Prior Foreign Application(s) 



11-002150 
(Number) 



11-340467 
(Number) 
(JS#> 

PCT/JPOO/00041 
(Number) 



(Number) 



^ . (Number) 



(Number) 



(Coun^) 
(SI*) 

Japan 
(Country) 

PCT 
(Counhy) 
(D0«) 



(Country) 



(Country) 



^Application No.) (Filing Date) 

celt:, TS2«)Vx<J^'i:4*fflffla(c-3V^T<{,, -twjieiiijg 
iffl^SSii^**^*^'' ****** 5t*EB*»S-*-5v>«> 

a H H t $ m rt ffl a B * fc (3 p c T ea 85 ja H H i <5 M CO jts isi 11 A * 



I hereby claim foreign priority under Title 35, United States 
Code, Section 119(a)-(d) or 365(b) of any foreign application(s) for 
patent or inventor's certificate, or 365(a) of any PCT International 
application which designated at least one country other than the United 
States listed below and have also identified below, by checking the box, 
any foreign apphcation for patent or inventor's certificate or PCT 
intemational application having a filing date before that of the 
apphcation for which priority is claimed. 

Priority Not Claimed 



7 January 1999 
(Day/MonthA'ear Filed) 



30 November 1999 
(Day/MonthA'ear Filed) 



7 January 2000 
(Day/MonthA'ear Filed) 



(Day/Month/Year Filed) 



(Day/MonthA'ear Filed) 



(Day/MonthA'ear Filed) 



I hereby claim the benefit under Title 35, United States Code, Section 
1 19(e) of any United States provisional application(s) listed below. 



(Application No.) 



(Filing Date) 



I hereby claim the benefit under Title 35, United States Code, Section 

120 of any United States apphcation(s), or 365© of any PCT 
intemational application designating the United States, listed below and, 
insofar as the subject matter of each of the claims of this application is 
not disclosed in the prior United States or PCT Intemational application 
in the manner provided by the first paragraph of Title 35, United States 
Section 112, I acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of Federal 
Regulations, Section 1.56 which became available between the filing 
date of the prior application and the national or PCT intemational filing 
date of application. 



(Application No.) 



(Filing Date) 
(fflHH) 



® l^SSl£° ^Kiiiam 



(Status: Patented, Pending, Abandoned) 



I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may 
jeopardize the validity of the application or any patent issued 
thereon. 
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POWER OF ATTORNEY: As a named inventor, I hereby appoint 
the following attomey(s) and/or agent(s) to prosecute this application 
and transact al business in the Patent and Trademark Office 
connected therewith (list name and registration number) 

WILLIAM S. FROMMER, Registration No._25,506.and 

DENNIS M. SMID. Registration No. 34.930 

Send Correspondence to: 

WILLI A M S. FR OMMER, Esq. 

c/o FROMMER LAWRENCE & HAUG LLP 

745 Fifth A venue 

New York, New York , 1 0151 



Direct Telephone Calls to: (212) 588-0800 

To the attention of: WILLIAM S. FROMMER 



Full name of sole or first inventor 



:73 Tsuvoshi TAKAGI 



inventor's signature 



Residence 
Chiba 



Citizenship 
Japan 



Post Office Address: 



Sony Corporation 
7-35 Kitashinagawa 6-Chome 
Shinagawa-Ku, Tokyo 141, Japan 



full name of second joint inventor, if any 



- c=<r- Masanori OMOTE 



Second Inventor's signature 



Date 



Kanagawa ^ " i -^^"'< 



Citizenship 
Japan 



Post Office Address 



Sony Corporation 
7-35 Kitashinagawa 6-Chome 
Shinagawa-Ku, Tokyo 141, Japan 



(Supply similar information and signature for third 
and subsequent joint inventors 
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